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Abstract. We consider a set of natural operations on languages, and 
prove that the orbit of any language L under the monoid generated 
by this set is finite and bounded, independently of L. This generalizes 
previous results about complement, Kleene closure, and positive closure. 

1 Introduction 



If t, x, y, z are (possibly empty) words with t — xyz, we say 

— x is a prefix of t; 

— z is a suffix of t\ and 

— y is a factor of t. 

If t = X\t\X2ti ■ ■ ■ x n t n x n+ i for some n > 1 and some (possibly empty) words 
ti,Xj, 1 < i < n, 1 < j < n + 1, then t\ ■ ■ -t„ is said to be a subword of t. Thus 
a factor is a contiguous block, while a subword can be "scattered" . 

Let L be a language over the finite alphabet E, that is, L C S* . We consider 
the following eight natural operations applied to L: 



k 


L - 


■> L* 


e 


L - 




c 


L - 


^L = S*-L 


P 


L - 


■> pref(L) 


s 


L - 


^ suff(L) 


f 


L - 


-> fact(L) 


w 


L - 


■> subw(L) 


r 


L - 





Here 



pref(L) 


= 


e u* 


x is a prefix of some y G L}; 


suff(L) 


= {x 


e E* 


a; is a suffix of some y G L}; 


fact(L) 


= {x 


e S* 


a; is a factor of some y G L}; 


subw(L) 


= {x 


e i7* 


x is a subword of some y G L}; 




= {x 


e Z"* 


x fl G £}; 



where x R denotes the reverse of the word x. 

We compose these operations as follows: if x = a\a 2 ■ ■ ■ a n £ {k, e, c,p, s, /, w, r}* , 
then 

x{L) = ai(a 2 {a 3 (- ■ ■ (a n (L)) ■ ■ ■ ))). 

Thus, for example, ck(L) = L* . We also write e(L) = L. 

Given two elements x, y G {fc, e, c,p, s, /, w, r}*, we write x = y if x(L) = y(L) 
for all languages L, and we write x C y if x(L) C for all languages L. 

Given a subset £ C {k,e,c,p, s, f,w,r}, we can consider the orbit of lan- 
guages 

O s (L) = {x{L) : xeS*} 

under the monoid of operations generated by S. We are interested in the following 
questions: when is this monoid finite? Is the cardinality of Os(L) bounded, 
independently of LI 

These questions were previously investigated for the sets S = {k, c} and 
S = {e, c} [4, 1] , where the results can be viewed as the formal language analogues 
of Kuratowski's celebrated "14-theorem" for topological spaces [3,2]. In this 
paper we consider the questions for other subsets of {k, e, c,p, s, f, w, r}. Our 
main result is Theorem 10 below, which shows finiteness for any subset of these 
eight operations. 

2 Operations with infinite orbit 

We point out that the orbit of L under an arbitrary operation need not be finite. 
For example, consider the operation q defined by 

q(L) = {x G U* : x there exists y £ L such that x is a, proper prefix of y }. 

Here by "x is a proper prefix of y" , we mean that x is a prefix of y with \x\ < \y\. 
Let L = {a n b n : n > 1}. Then it is easy to see that the orbit 

{q} (L) = {L,q(L),q 2 (L),q 3 (L),...} 

is infinite, since the shortest word in q l (L) n a + b is a l+1 b. 
The situation is somewhat different if L is regular: 

Theorem 1. Let q denote the proper prefix operation, and let L be a regular 
language accepted by a DFA of n states. Then 0{ q } (L) < n, and this bound is 
tight. 

Proof. Let M = (Q, £ ,5,qo, F) be an n-state DFA accepting L. Note that a 
DFA accepting q(L) is given by M' — (Q, S, <5, <7o, F') where 

F' = {q E Q : there exists a path of length > 1 from q to a state of F }. 

Reinterpreting this in terms of the underlying transition diagram, given a di- 
rected graph G on n vertices, and a distinguished set of vertices F, we are 



interested in the number of different sets obtained by iterating the operation 
that maps F to the set of all vertices that can reach a vertex in F by a path of 
length > 1. We claim this is at most n. To see this, note that if a vertex v is 
part of any directed cycle, then once v is included, further iterations will retain 
it. Thus the number of distinct sets is as long as the longest directed path that 
is not a cycle, plus 1 for the inclusion of cycle vertices. 

To see that the bound is tight, consider the language L n — {e, a, a 2 , . . . , a"~ 2 }, 
which is accepted by a (complete) unary DFA of n states. Then q(L n ) — L„_i, 
so this shows |0{ 9 }(L„)| — n. □ 

It is possible for the orbit under a single operation to be infinite even if the 
operation is (in the terminology of the next section) expanding and inclusion- 
preserving. As an example, consider the operation of fractional exponentiation, 
defined by 

n(L) — {x a : a > 1 rational } = x + p({x}). 

xeL 

Proposition 1. Let L = {ab}. Then the orbit 0{ n y(L) is infinite. 

Proof. We have aba 1 G n l ({ab}), but aba 1 £ n j ({ab}) for j < i. □ 



3 Kuratowski identities 

Let a :2 s — > 2 s be an operation on languages. Suppose a satisfies the following 
three properties: 

1. L is a subset of a(L) (expanding); 

2. If L C M then a(L) C a(M) (inclusion-preserving); 

3. a(a(L)) = a(L) (idempotent). 

Then we say a is a closure operation. Examples of closure operations include 
k, e,p, s, f, and w. 

Note that if a, b are closure operations, then their composition ab trivially 
satisfies properties I and 2 above, but may not satisfy property 3. For example, 
pk is not idempotent, as can be seen by examining its action on L = {ab} 
(aab £ pk(L), but aab <G pkpk(L)). 

Lemma 1. Let a G {k, e} and b G {p, s, /, w}. Then aba = bab = ab. 

Proof. We prove the result only for b = p; the other results are similar. 

Since L C a(L), we get p(L) C pa(L), and then ap(L) C apa(L). It remains 
to see apa(L) C ap(L). 

Any element of a(L) is either e or of the form t = t\t2 ■ ■ ■ t n for some n > 1, 
where each ti G L. Then any prefix of t looks like t\t2 ■ ■ ■ ti-ipi for some i > 1, 
where pi is a prefix of ti, and hence in p(L). But each ti is also in p(L), so this 
shows 

pa(L) C ap(L). (I) 



Since a is a closure operation, apa(L) C aap(L) = ap(L). 

Similarly, we have ap(L) C pap(L). Substituting p(L) for L in (1) gives 
pap(L) C app(L) = ap(L). □ 

Lemma 2. TTie operations kp, ks, kf, kw, ep, es, e/ and ew are closure opera- 
tions. 

Proof. We prove the result for kp, with the other results being similar. It suffices 
to prove property 3. From Lemma 1 we have pkp(L) = kp{L). Applying k to 
both sides, and using the idempotence of k, we get kpkp(L) = kkp(L) = kp{L). 

□ 

If a is a closure operation, and c denotes complement, then it is well-known 
(and shown, for example, in [4]) that acacaca = aca. However, we will need the 
following more general observation, which seems to be new: 

Theorem 2. Let x,y be closure operations. Then xcycxcy = xcy. 

Proof, xcycxcy C xcy: We have L C y(L) by the expanding property. Then 
cy(L) C c(L). By the inclusion-preserving property we have xcy(L) C xc(L). 
Since this identity holds for all L, it holds in particular for cxcy(L). Substituting, 
we get xcycxcy(L) C xccxcy(L). But xccxcy(L) = xcy(L) by the idempotence 
of x. 

xcy C xcycxcy: We have L C x{L) by the expanding property. Then, replac- 
ing L by cy(L), we get cy C cccy. Applying c to both sides, we get ccccy C ccy = y. 
Applying y to both sides, and using the inclusion-preserving property and idem- 
potence, we get ycxcy Q yy = y. Applying c to both sides, we get cy C cycxcy. 
Finally, applying x to both sides and using the inclusion-preserving property, we 
get xcy C xcycxcy. □ 

Remark 1. Theorem 2 would also hold if c were replaced by any inclusion- 
reversing operation satisfying cc = e. 

As a corollary, we get [4, 1]: 

Corollary 1. If S = {a,c}, where a is any closure operation, and L is any 
language, the orbit Os(L) contains at most 14 distinct languages. 

Proof. The 14 languages are given by the image of L under the 14 operations 

e, a, c, ac, ca, aca, cac, acac, caca, acaca, cacac, acacac, cacaca, cacacac. 

a 

Remark 2. Theorem 2, together with Lemma 2, thus gives 196 separate identi- 
ties. 

In a similar fashion, we can obtain many kinds of Kuratowski-stylc identities 
involving k, e, c,p, s, /, w and r. 



Theorem 3. Let a E {fc,e} and b E {p, s, f, w}. Then we have the following 
identities: 

4- abcacaca = abca 

5. bcbcbcab = bcab 

6. abcbcabcab = abcab 

Proof. We only prove the first; the rest are similar. From Theorem 2 we get 
acacaca = aca. Hence ab(acacaca) = ab(aca), or cquivalcntly, aba(cacaca) = 
aba(ca). Since aba = ab from Lemma 1, we get abcacaca = abca. □ 



4 Additional identities 

In this section we prove some additional identities connecting the operations 
{k,e,c,p,s,f,w,r}. 

Theorem 4. We have 

7. rp = sr 

8. rs = pr 

9. rf = fr 

10. rc = cr 

11. rk = kr 

12. rw = wr 

13. ps = sp = f 
11 pf = fp = f 

15. sf = fs = f 

16. pw = wp = sw = ws = fw = wf = w 

17. kw = wk 

18. rkw = kw 

19. ek = ke = k 

20. fks ee pks 

21. fkp = skp 

22. rkf EE Skf EE pkf EE fkf EE kf 

Proof. All of these are relatively straightforward. To see (20), note that p(L) C 
f{L) for all i, and hence pks(L) C fks(L). Hence it suffices to show the reverse 
inclusion. 

Note that every element of ks(L) is either e or can be written x = sis 2 • • • s n 
for some n > 1, where each Si G s(L). In the latter case, any factor of x must be 
of the form y = s'[si + i ■ ■ ■ Sj^is'j, where s" is a suffix of Si and s'^ is a prefix of 
Sj. Then s"s i+ i ■ ■ ■ Sj_iSj G ks(L) and hence y G pks(L). 

Similarly, we have pkf = pk(ps) = (pkp)s = (kp)s = k(ps) = kf, which 
proves part of (22). 



Theorem 5. We have 
23. pcs(L) = S* or 0. 

24- The same result holds forpcf, fcs, fcf, scp, scf, fcp, wcp, wcs, wcf, pew, sew, 
few, wcw. 

Proof. Let us prove the first statement. Either s(L) = E* , or s(L) omits some 
word v. In the former case, cs(L) = 0, and so pcs(L) = 0. In the latter case, we 
have s(L) omits v, so s(L) must also omit U*v (for otherwise, if xv G f(L) for 
some x, then v G s(L)). So S*v C cs(L). Hence pcs(L) = £*. 

The remaining statements are proved similarly. □ 

The following result was proved in [1, Theorems 2 and 3]. 

Lemma 3. We have ecece = cece. 

Theorem 6. Let L be any language. 

25. We have kckck(L) = ckck(L) U {e} . 

Proof. First, suppose e e L. Then e(L) = k(L) and ce(L) — ck(L). Since e ^ 
ck(L), we obtain ece(L) = eck(L) = kck(L) — {e}. Then, cece(L) = ckck(L)U{e}. 
So ecece(L) = kckck(L). From Lemma 3, we deduce kckck(L) = ecece(L) = 
cece(L) = ckck(L) U {e}. 

Second, suppose e ^ L. Then e(L) = k(L) - {e} and ce(L) = ck(L) U {e}. 
We obtain ece(L) ~ kck(L) and cece(L) = ckck(L). So ecece(L) = eckck(L) = 
kckck(L) — {e}. From Lemma 3, we deduce kckck(L) = ecece(L)U{e} = cece(L)U 
{e} = ckck(L) U {e}. 

Lemma 4. Let L be any language. 

(a) If xy G kp(L) then x 6 kp(L) and y G kf{L). 

(b) If xy e ks{L) then x G kf{L) and y G ks(L). 

(c) Ifxyekf(L) then x,y G kf(L). 

(d) If xy G kw{L), then x,y G kw{L). 

Proof. We prove only (b), with the others being proved similarly. If G ks(L), 
then x G pks(L) and y G sks(L). But s G /, so pfcs G pfc/, and pfc/ = kf by 
(22). Hence x G kf(L). Similarly, sks = ks by Lemma 1, so y G ks(L). □ 

Lemma 5. IFe Ziawe pepekp G fcp. 

Proof. Let x G pcpckp(L). Then there exists j/ such that xy G cpckp(L). So 
xy ^ pckp(L). Then, for all z, we have xyz ^ ckp(L). Hence xyz G kp(L). Thus 
x G pkp(L) = kp{L). 

Theorem 7. Let b G {p, s,/, w}. Then 



26. kcb(L) = cb{L) U {e} 
^7. fccfcfe(i) = ckb(L) U {e} 



28. kbcbckb(L) = bcbckb(L) U {e}. 



Proof. We prove only three of these identities; the others can be proved similarly. 

kcp(L) = cp(L) U {e}: Assume x G kcp(L). Either x — e or we can write 
x = x\Xi ■ ■ ■ x n for some n > 1, where each xi G cp(L). Then each Xi £ p(L). In 
particular x\ ^ p(L). Then xix 2 ■ ■ ■ x n p(L), because if it were, then x\ G p(L), 
a contradiction. Hence x G cp{L). 

kckp(L) — ckp(L) U {e}: Assume x G kckp(L). Either x = e or we can write 
x = X1X2 • ■ ■ x n for some n > 1, where each Xj G ckp(L). Then each a;, ^ kp(L). In 
particular xi G" kp(L). Hence x\{x-i ■ ■ ■ x n ) kp(L), because if it were, then x\ G 
kp(L) by Lemma 4, a contradiction. Hence x g" kp(L), so x G ckp(L), as desired. 

kpcpckp(L) = pcpckp(L) U {e}: Assume x G kpcpckp(L). Either x = e or we 
can write x = x\ ■ ■ ■ x„, where each Xj G pcpckp(L). In particular, there exists y 
such that x n y G cpckp(L); that is, x„y ^pckp{L). Assume x ^pcpckp{L). Then 
xy cpckp(L), so xy G pckp(L). Then there exists z such that xyz G ckp(L); 
that is, xyz kp(L). But from Lemma 5, we know that every x% is in kp(L). 
Further, since x n y pckp(L), we have x n yz g' ckp(L); that is, x n yz G kp(L). 
This shows that xyz = Xi • • • x„_i(x„yz) belongs to kp(L), a contradiction. □ 

Theorem 8. We /iave 

25. scfcp(L) = 17* or 0. 

50. T/ie same result holds for fckp, peks, fcks,pckf, sckf, fckf, wckp, wcks, wckf, 
wckw,pckw, sckw, fckw. 

Proof. To prove (29), note that either kp(L) = S* , or kp(L) omits some word 
v. In the former case, ckp(L) = 0, and so sckp(L) = 0. In the latter case, we 
have kp(L) omits v, so kp(L) must also omit vZJ* (for otherwise, if vx G kp(L) 
for some x, then v G fcp(L) by Lemma 4, a contradiction). Then vS* G ckp(L) 
and hence sckp(L) = S* . 

The other results can be proved similarly. □ 

Lemma 6. Let L be any language. 

(a) If xy G skp(L), then x, y G skp(L). 

(b) If xy G pks(L), then x, y G pks(L). 

Proof. We prove only (a), with (b) being proved similarly. 

If xy G skp(L), then x G pskp(L) and y G sskp(L). But ps/cp = (ps)kp = 
fkp = skp by (21). So x G skp(L). Also, ss/cp = sfcp, so y G skp(L). □ 

Theorem 9. We ftave 

5L scskp(L) = S* or 0. 

52. TTie same result holds for pepks. 

Proof. We prove only the first result; the second can be proved analogously. 
Either skp(L) — S* , or it omits some word v. In the first case we have cskp(L) = 
and hence scskp(L) = 0. In the second case, skp(L) must omit vS* (for if 
vx G skp(L) for any x, then by Lemma 6 we have v G skp(L), a contradiction). 
Hence scskp(L) = S* . □ 



5 Results 



Our main result is the following: 

Theorem 10. Let S = {k, e, c,p, /, s, w, r}. Then for every language L, the set 
Os{L) contains at most 5676 distinct languages. 

Proof. Our proof was carried out mechanically. We used breadth-first search to 
examine the set S* = {k, e, c,p, /, s, w, r}* by increasing length of the words; 
within each length we used lexicographic order with k<e<c<p<f<s< 
w < r. The nodes remaining to be examined are stored in a queue Q. 

As each new word x representing a series of language operations is examined, 
we test it to see if any factor is of the form given in identities (23)-(24) or (30)- 
(32). If it is, then the corresponding language must be either S* , 0, {e}, or S + ; 
furthermore, each descendant language will be of this form. In this case the word 
x is discarded. 

Otherwise, we use the remaining identities above to try to reduce x to an 
equivalent word that we have previously encountered. If we succeed, then x is 
discarded. Otherwise x(L) is potentially a new language, so we append all the 
words Sx to the end of the queue. Some simplifications are possible. For example, 
using our identities we can assume x contains only a single r and this appears 
at the end; this cuts down on the search space. 

We treat the identities (25)-(27) somewhat differently. We keep track of 
whether a language contains e or not. For example, when appropriate, we can 
replace akcb with acb for a, b G {p, s, /, w}. 

If the process terminates, then Os{L) is of finite cardinality. 

We wrote our program in APL. For S = {k,c,p, f, s,w,r}, the process ter- 
minated with 5672 nodes that could not be simplified using our identities. We 
did not count 0, {e}, S + ', and E* . The total is thus 5676. 

The longest word examined was ckcpcpckpckpckpcpcpckckcr, of length 25, 
and the same word with p replaced by s. 

Our program generates a complete description of the words and how they sim- 
plify, which can be viewed at www.cs.uwaterloo.ca/~shallit/papers.html. 

□ 

Remark 3. If we use two arbitrary closure operations a and b with no relation 
between them, then the monoid generated by {a, b} could potentially be infinite, 
since any two finite prefixes of ababab ■ ■ ■ are distinct. 

Here is an example. Let p denote prefix, as above, and define the exponenti- 
ation operation 

t(L) — {x l : ieL and i is an integer > 1}. (2) 

Then it is easy to see that t is a closure operation, and hence the orbits 0{ p j (L) 
and Or t \(L) are finite, for all L. However, for L = {ab} 7 the orbit Or Ptt \(L) is 
infinite, as aba 1 6 (pt) l (L), but aba 1 £ (pt) J (L) for all j < i. 

Thus our proof of Theorem 10 crucially depends on the properties of the 
operations {k, e, c,p, s, f, w, r}. 

We now give some results for some interesting subsets of S. 



5.1 Prefix and complement 



In this case at most 14 distinct languages can be generated. The bound of 14 
can be achieved, e.g., by the regular language over S = {a, b, c, d} given by the 
regular expression a*((b + c)(a(SS)* + b + dS*) + dE + ) and accepted by the 
DFA in Figure 1. 



a, b, c, d 




Fig. 1. DFA accepting a language L with orbit size 14 under operations p and c 



Table 1 gives the appropriate set of final states under the operations. 



language 


final states 


language 


final states 


L 


3,7,8 


pcpc(L) 


1,5,6,7 


c(L) 


1,2,4,5,6 


cpcp(L) 


2,3,6,7 


P(L) 


1,2,3,5,6,7,8 


cpcpc(L) 


2,3,4,8 


pc(L) 


1,2,3,4,5,6,8 


pcpcp(L) 


1,2,3,5,6,7 


cp(L) 


4 


pcpcpc(L) 


1,2,3,4,5,8 


cpc(L) 


7 


cpcpcp(L) 


4, 8 


pcp(L) 


1,4,5,8 


cpcpcpc(L) 


6, 7 



Table 1. Final states for composed operations 



5.2 Prefix, Kleene star, complement 

The same process, described above for the operations {k, e, c,p, s, f, w, r}, can 
be carried out for other subsets, such as {k, c,p}. For this our breadth-first search 
gives 1066 languages. The longest word examined was ckcpcpckpckpckpcpcpckckc. 

5.3 Factor, Kleene star, complement 

Similarly, we can examine {fc, c, /}. Here breadth-first search gives 78 languages, 
so our bound is 78 + 4 = 82. We can improve this bound by considering new 
kinds of arguments. 



Lemma 7. Let L be any language. There are at most 4 languages distinct 
from S* , 0, S + , and {e} in 0{ k j tkc j c y(f(L)). These languages are among f(L), 
kf(L), kckf(L), and kcf(L). 

Proof (Sketch). First observe that the set of languages {£*, 0, S + , {e}} is closed 
under any operation of the set {k, c, /}. We make a case study. We consider 
successively the languages generated by {k, /, fee, fc} from fcf(L),kf(L), and 
kcf(L). We make use of Identities (22), (24), (26), (27), and (30). 

Let alph(L) denote the minimal alphabet of a language L, that is, the minimal 
set of letters that occur in words of L. 

Lemma 8. Let L be any language. We have kf(L) = fc(alph(L)). 

Proof. The minimal alphabets of L and f(L) coincide. Thus f(L) C fc(alph(L)), 
so kf(L) C fc(alph(L)). Further, alph(L) C f(L). So fc(alph(i)) C kf(L) as well. 

Lemma 9. Let L be any language. There are at most 2 languages distinct from 
i7*,0, £+, and {e} in {kJM j c }{fk(L)) - {k j MJc }(f(L)). These languages 
are among fk(L) and kcfk(L). 

Proof. Apply Lemma 7 to k(L) and use kfk = kf. To see the latter identity, 
use Lemma 8 and observe that alph(fc(L)) = alph(L). 

Lemma 10. For any language L, we have either f(L) = S* or fc(L) = S* . 

Proof. Assume f{L) ^ E* . Then there exists a word in cf(L), say w. Hence 
E*wE* n f(L) = 0. Since L C f(L), we also have Z*wE* n L = 0, that is 
£*w£* C c(L). This implies fc{L) = £*. 

Theorem 11. 50 is a tight upper bound for the size of the orbit of {k, c, /}. 

Proof (Sketch). From Lemmas 7 and 9, and Identity (25), starting with an arbi- 
trary language L, the languages in 0{ k _ c jj(L) that may differ from Z'*,0,Z ,+ , 
and {e} are among the images of L and c(L) under the 16 operations 

/, kf, kckf, kef, fk, kefk, fck, kfck, kckfck, kefek, (3) 
fkek, kefkek, fekek, kfekek, kekfekek, kefekek. 

the complements of these images, together with the 14 languages in Or kfC \(L). 

By using Lemma 10, we show that there are at most 32 pairwise distinct 
languages among the 64 = 16 • 4 languages given by the images of L and c(L) 
under the 16 operations (3) and their complements. 

Adding the 14 languages in Os k c \(L), and £*,$, S + , and {e}, we obtain 
that 50 = 32 + 14 + 4 is an upper bound for the size of the orbit of {k, c, /}. 

The bound is tight because the language L given by two copies (over disjoint 
alphabets) of the language accepted by the DFA of Figure 2 over the alphabet 
{a,b,c,d,e, f,g,h,i} (i is a letter that does not occur in any word of L, i.e., 
i £ alph(L)) has 50 pairwise distinct elements in 0{ k>c j}{L). 



Fig. 2. The DFA made of two copies of this DFA accept a language L with orbit size 
50 under operations k, c, and /. 



5.4 Kleene star, prefix, suffix, factor 

Here there are at most 13 distinct languages, given by the action of 

{e, k,p, s, /, kp, ks, kf, pk, sk, fk,pks, skp}. 
The bound of 13 is achieved, for example, by L — {abc}. 

5.5 Summary of results 

Table 2 gives our upper bounds on the number of distinct languages generated 
by the set of operations. An entry in bold indicates that the bound is known to 
be tight. Some entries, such as p, r, are omitted, since they are the same as others 
(in this case, p, s, /, r). Most bounds were obtained directly from our program, 
and others by additional reasoning. An asterisk denotes those bounds for which 
some additional reasoning was required to reduce the upper bound found by our 
program to the bound shown in Table 2. 

6 Further work 

We plan to continue to refine our estimates in Table 2, and pursue the status 
of other sets of operations. For example, if t is the exponentiation operation 
defined in (2), then, using the identities kt = tk = k, and the inclusion t C k, 
we get the additional Kuratowski-style identities ketckek = kck, kekctek = kck, 
kctctck = kck, tctctck = tck, and kctctct = kct. This allows us to prove that 
®{k,c,t}{L) is finite and of cardinality at most 126. 
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